Towards Robust Lip Tracking
نویسندگان
چکیده
An algorithm for the automatic extraction of speakers lips in video sequences is presented here. Our goal is to extract minimum face feature parameters, vital for audio-visual communication, in adverse conditions and at a very low bit rate coding. Our method uses spatial (region and contour) and temporal (similarity function) information from Luminance and Hue components. A new literal inverse of the active contours stiffness matrix is introduced. This ensures a fast and accurate convergence of active contours towards lips boundaries. The use of Kanade-Lucas tracking algorithm with our point extraction method leads to an automatic, fast and robust initialization of Snakes. The significant robustness enhancement and related computational cost decrease allow processing approaching real time.
منابع مشابه
Lip Tracking Towards an Automatic Lip Reading Approach
Current era is to make the interaction between humans and their artificial partners (Computers) and make communication easier and more reliable. One of the actual tasks is the use of vocal interaction. Speech recognition may be improved by visual information of human face. In literature, the lip shape and its movement are referred to as lip reading. Lip reading computing plays a vital role in a...
متن کاملRobust Lip Tracking by Combining Shape, Color and Motion
Accurately tracking facial features requires coping with the large variation in appearance across subjects and the combination of rigid and non-rigid motion. In this paper, we describe our work toward developing a robust method of tracking facial features, in particular, lip contours, by using a multi-state mouth model and combining lip color, shape and motion information. Three lip states are ...
متن کاملA local region based approach to lip tracking
Lip tracking has played a significant role in a lip reading system. In this paper, we present a local region based approach to lip tracking, which consists of two phases: (i) lip contour extraction for the first lip frame, and followed by (ii) lip tracking in the subsequent lip frames. Initially, we construct a localized color active color model provided that the foreground and background regio...
متن کاملDesign of robust carrier tracking systems in high dynamic and high noise conditions, with emphasis on neuro-fuzzy controller
The robust carrier tracking is defined as the ability of a receiver to determine the phase and frequency of the input carrier signal in unusual conditions such as signal loss, input signal fading, high receiver dynamic, or other destructive effects of propagation. An implementation of tight tracking can be understood in terms of adopting a very narrow loop bandwidth that contradict with the req...
متن کاملRobust Control of a Quadrotor
In this paper, a robust tracking control method for automatic take-off and trajectory tracking of a quadrotor helicopter is presented. The designed controller includes two parts: a position controller and an attitude controller. The attitude controller is designed by using the sliding mode control (SMC) method to track the desired pitch and roll angles, which are the output of position controll...
متن کامل